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Watennailc deteotion 



FIELD OF THE INVBNnON 

The inv^tion relates to a method atidl oixangement for detecting a wateinxiaric 
in amedia signal 



5 BACKGROUND OF THE INVENTION 

Until very recently the DVD copy-protection conminnity consid^d 
watermark-deteotion for playbaofe^ontrol in a Personal Computer to take placa in the DVD- 
ROM or DVD-rewxitra drive. Hie motivation fbr this position was that watennark-detection 
is a pennissive technology <i.e. Ibe playback or recording device works with or without 

10 wateimaik detector) as opposed to encryption, which requires a doczyptor for the device to 
fbnction properly. The fragile consensus used to be that DVD-ROM drives would mspect 
MPEG2^n^ressed unenctypted DVD-video content on dislss for presence of a copy-never 
or cppy'-once watemiaik. If such were the case, playback should be stopped (cqpy-<ince or 
copy-never content should be enoypted at all times). Note that such a ^ve needs an 

15 MPB02-par8er to at least partially decompress cotitent to enable watermark detection. See 
Fig. Ip whiob shows sohematioaUy a PC system architeoture of watermark-detection fbr 
ptaybaok-control in the DVD-drive. 

However, a system with playbadc-conlxol using a watermark detector in the 
drive leaves mstJor security boles in an open-architecture PC. One such security hole is that 

20 content maybe recorded in scrambled fbnn by fUpping all bits. Since Oiis is no bngor a 
compliant MPBG2 stream, the parser in the drive will fall and no watezmark will be seen. 
The bi^£lip can be undone Just before or Inside the media^layer software. Anotiier such 

secerii^hole is that content nuiy be conqnns^ 

under the name Div^Of fiaetal-comprearion schemes^ Windows Media, Real, etc. Since it is 

25 inqsossible for the DVD-drive to have parsers on board to ^ardedly) decompress all of these 
(and hackers will invent new co decs to outsmart the drive), the watermark wiU not b e 
detected. Althougih (illegal) copies con^ressed with a codec oth^ than MPEG2 will 
gsnerdly not play on current D VD-<video players there is a trend for DVD-video players to 
support more and mcne codecs. 
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ThecefiMS it has alnsady been pcoposed to place the watexmaik detector after 
deoomptoB^oa and just befiwo rendering, ie. in an MPECMeooder Owidware) card or k a 
gcai^os md, AlbBc deoon^resdon flioM is no longer confiiakm because aU content reduces 
to flio Hnequivooal basebaod-fiwwat ready for coniuniition by hnman eyes. Rg. 2 shows 
5 scihfimalicajly sncih a PC systeni-aiohltectare of wateimaric-detection &r plaj^aok-contcol in 
the gcqE>biofl card. Hbwevef, it was considered difBcult to enfoioe MPBCMeooder companies 
or grj?)hios-c8id manufeotarara to install sneh watennaifc deteotots. Tbis perception has 



changed since. An anshiteotore is now baing envisaged in whidi DVD-diives chock, on boot- 
up, whether there is a gr^os^aid with watenowA deteotar present in the PC. H such a 

10 gcaphics-oard with watennarkrdetector is not present flien the drive will not output data. If 
soch a special graphics card is present however, it will culpa* data. Whan the waletmajk 
detector in ihe gr^Wos card detects a watennaik it will fay to autheotioate to a oonnpliant 
appUcation which is responsible for rendering the wateimarked date. If sudi anfeenticatlon is 
succeasM,1he graphics card continues operation (e.g. a yaUd DVD-Video is being played 

15 back using an aufliorized application). If it cannot find such a compHant ^Hcaflon, flxe 

content must have come ftom some non-auflioiized source, e.g. an illegally copied disk in the 
drive is bdng rendered by some phrate or other uon-compUant software. The gr^hics oazd 
wiU then shut down such ou^ut Pig. 3 schematioally shows a dcetdh of protocols in audi a 
PC architeotore to make sure that all components are ftiuotioning ensure watennark detection. 

20 In lius Figure, "Anth." denotes an authentication process or device. Note that the compliant 
i^Ucation is certain about the origins of the data which it is rendering because it has also 

With the drive. Note also that the architecture is more general. For example, the 
eoatoe may also be an analog capture caid, an MPBG-encoder card, or an JBEB-ISM board, 

railier than a DVD-drive. 
25 It will fintber be assumed that the watennark detector is located on the 

output(s) of the graphics cand, just befbre video data is converted to the analog domain or 
modulatedinflwdi^taldomainfbrtransmiasionto ADVI-anonitor (seePig. 2). Although it 

la arehiteoturaUy very simple and ©lean to detect watacmarics in the graphics-card, in practice 

there are amnnber of pioblems wKh«iis location comaected to m enomious amounts of 
30 (grai&ics)datathatflowtlaou^lJiegraiflnospartrt 
streams can be displayed at 'die same time. 

The video coming out of the grapWc&^aid can be at any number of 

resolutions, see the Tdsle below: 
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Standard 


Rfisolnflon 


ptjEei-cIock [MHzJ 


VGA. 


640 x 480 


27 


XGA 


1024x768 


70 


SXOA 


1280x1024 


116 


UXGA 


1600 X 1200 


170 


Table: Comparison of tho resolutiom and pixel-dock of some 
cimuxum graphics standards 



There axe oilier also oHier statidaida supported by some gn^bios cards, 'witbt itttaipolatiag 
teaobiticms. Note (bat the pbcel-^DlooJe fas uemai baseband watemiadc deteotloa (in PAL or 
m'SC)ial3.5MHz. 

5 S|pecificalb^» some of Ibe pioblems fi>r watemuuk detection in. fbo gr^sbics 

card are; 

1. The otilpot interfeoe has up to 13x hi^ data rate (UXGA-mode) compared to acmnal 
P AI/NTSC baseband-doteotioa Baseband detection reqidrea one addition fi» every : 
pixel, so the adder has to ymk. 13x fiutter. 

10 2. The data on tbe outputs is in RGB fbrmat whereas most watetmark-sch«TOes work with 
the hmunanoe ohamieL Conversion ftom RGB to Y reqwres 2 additiona and 2 
mnMpUcations ((y/0.587) m 0.509 R + G + 0,194 B, whei© OS B,G3 < 1). This is very 
costly, e^eoially at hi^ data rates. 
3. Tbe potential range of scales diat the detector needs to deal witb is very large. One of 

15 the highest scales still preserving visual quafity is to display the movie fUUrscreen on 

Ibe monitor (blow up lo 1600x1200 or even more). Hourly the lowest scale is when 
fli» video is reduced to 352x200 (a popular firanatfer downloading movies from the 
intemet). The soate-range horiaontaDy is thus 0.5. ..2.2 and vraticaUy 0A...2.5, vi^aeas 
Gurxeiitly avaiUble watennaifc detectors are designed to dealwifli scales biUi© range 

20 0.5..4.5. 

4... A8diowttittFig..2,lbei©areusiiaMymnttIideoulp«tsonfliegra|^ 

VQA^nt and TV-out (fer dispbiying a DVD-movie tendered on aPC on a Uving^Dom 
TV). Recently tbe digital DVI-iateefiwe baa been addedto this palette. Beosuse all 
fhesoou^ canbeconhonedfaidqieadenfly (ie. display different data), naively the 
25 ijinnberofdeteotoreshoold equal to Ibe nnmber of outputs, wMo^ 

ngoificant cosMnuden. 
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5. fil the arobitectore of Figs. 2 and 3» a haoloer may pecform the Mowing back: (s)!ie 
copies illegal content vMok (a^e wants to watch from a DVD-hR to the HDD, without 
rendering. 131611 (s)he plays any valid protected DVD-video fix>m the DVD-<lriye with a 
coi^pliant fijtplioation in one whidow, while Ihe illegal material is xendexed by a nan- 

5 compliant ^plicafion in another window* The watennark detector will find a 

wateamarfc biit that is (it thinks) conaistent with the orisinal movie in the drive. Thus 

the Illegal material is not caught. It is even possible to abuse a compliant application: 
the illegal content ftom the HDD can re-encrypted with CS3 (which has been hacked), 
thus disguising it as valid content This ReCSS-ed conteAt is thus accepted by the 
10 compliant player, and after watermark detection in the graphics card, this application 

will vouch fi»r it 

6. If a watermark is fovmd by the compliant graphics card but no compliant application 
which produced the (watermarked) video can be found (or the drive cannot confirm that 
the source is indeed a DVD-Video disk)^ what should the grqihics card do to stop the 

15 display ofihe illegal movie? 

7. Jn the architectme of Ei^. 2 and 3, a hacker may perfonn the fbUowlng hack: he 
inserte a second non-compliant graphics card into the PC. He allows the drive to 
auth^ilicate to the graphics card (using a hacked driver), while he uses the non- 
compUant card to playback illegal material fiom the drive. A second hack scenario is 

20 when he only inserte a non-compliant gr^hics card into his PC but connects the PC via 

a netwoxk (home netwoik or internet) to another PC with a conipliant gr^hica card. 
After authenticating the drive with the lonote compliant gt^hios^card^ illegal content 
ia displayed on the on-boaxd non-coxopliant gEq)hics card. A third hack scenario is 
where there is a complian t DVD-drive and a compliant graphics card with watennark 

25 detector in asingle PC: after authentication the hacter streams the data ftom illegal 

disk in the drive to a non-compliant appUcation running on another PC wi<b anon-" 
compliant gcsqddcs card somewhere in the networis. 
. .... 8. .Abackernmyopeia.ig;^ the grapMcs card and lea^ • * 

Oike what happened Ibr DVD-Video), and publish it on the net From thm on, a 

30 compliant graphics card can always be in^ersonated by a non-conspliant grq>hic8 card 

phis q»ecial software tool uGong this secret Of course the backer may also steal the 
watermark-secret, but removing a watomiaric ftom a movie is computationally mu6h 
more woric intensive than feWng an authentication. 
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OB JBC5T A^© SUMRIARY OP THE 

III tl]i3 section we pxx>vide a set of possible soMoas to fiie problems 1 to 8 
5 mgnHoiied above. The aame tmfnli^ng fa ftdherfld to. 

1. Trivially: tibe pixel-data is sub-sampled in qiace and time (by skipping): e^g, the only 
infbnnation used fOT detection is line 1 flomfiame 1^ line 2 from fiam02 etc. 
Alternatively, only a part of the imai^s is being watennark detected: see also soltttion 3 
below. 

10 2. The multiplications to convert from RGB to Y can be avoided by approximathig Y, 
e.g. Y « 0.25 R + 0.5 G + 0. 125 B = R/4 + G/2 + B/S which can be implemented with 
only arithmetic Shifts. Furthemiore;, to economize on additionSy we can ^pxoximate 
fcrthw Y » Q (because Q is dominant). 

Attematively, tiie 3 primary colors ISL^Q^a can be accumulated / folded / processed 
15 sepamtely^ ushig 3 sqpaxate fold-buf&is. Thra after folding, RGB can be converted to 

Y o£f«^Irrie> mstead of on-fiie^fly (this is much like the way in which Imown watermarie 
detectois accumulate DCT-coefScients on which finally an IDCT is perfomied father 
than pecfomUng an IDCT on-the-fly and then accumulate the resulting pixels). This 
pcrocedure takes 3 times more memory but it can usually still be ne^cted w.r.t tiie 
20 amounts of video-memory used fbr other purposes. Memory bandwidth can be a 

problem though, because 3 times as much data must be transported to memoty» 
3. It is usually quite easy to distinguish video from all llie otb^ information on the 

desktop, because real-tfane video contains many xobre changes. This could lead to the 
following soh)tions: 
25 a. the watemiaiik defector atoies the (tbreshoMed) changes w^ 

previoud frame, ft tries to fit a bounding box around (rectangular area that 
hidudes) areas witii significant ohangCplliatboundhig box ^ be consideEed a 

- — ^ - window on normal watemiark detection (scsledet^ 

payload detection) is pqifomie& In otii^wonlsj whereas befbre we ^ 
30 scale detection and payload detection, we have now added ^'arearof-jitterest- 

detection*'. Fig. 4 shoes sohematiGally the structure of graphics-card watermark- 
ctetectlon according to this solution, 
b. same as a.j but the cehaciuie-detectitm is perfimned on a sub^sampled video-frame 
I to conserve storage space. 
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e. same as a, but fhe ehangesdeteotion is pofonned ^lock-jEbr-blodsf (e.g. first tty 

to find file changB-aieas in fiie top-lefi comsr, tb» Infite top-xie^t wsam etc.). 
tt is well Imown fi»m fiifl Uteratote Ii0w, Btartfa^ 

detetjoine the tightest possible boumding-bax (red rectangle in figoze above) including 
5 soob a point If fiie content in the arearcf-interest is now upsanxpled or downsampled to 

the noxmal 720x480 or 720x576 fbcmat, and s»q>pHed to a notmal baseband watennafic 
detector, it is very likely fiiat the content ia now proc^s^ at a scale safEioieat^ close 
to 1.0. 

4. Hme-nniltiplex fiie watennadc detector onto the difEbrsnt outputs: i.e. fiiat detect fi>r a 
10 fixed amount of thne on output I, then on ouQiut 2 etc. It is also posi^le to ofaeok all 

outputs simultaneously. 

5. 'When the detector has fbnnd watemiaKked conteni^ wbicb (through authentication) can 
bo traced back to a compliant ^plication or drive, the wateimark detector should 
continue to search other areas of file di^Iay, to search illegal content ^th watcmiadcs. 

15 &i practice one could implement fiiis by starting the bouuding-box search of solution 3 

at a random point on the di^Iay. to avoid ending up with the same bounding^boz all 
the time. As an alternative the graiihics card may notify the drive of fiie watemiark- 
pa^doad using the aufli«ntioated channel set up at boot-time. The drive can verify ftom 
the whether this watemiark-payload is commensurate with this disk. If not; some 

20 ofiier source of copied material must exist. Note that Ibr this method to woric, the 

watemiatk'-payload needs to be stored on the disk in a manner that it camiot be 
reeved by a hadker, eug. in some curreofiy unused sector in the lead-in area. This does 
not add cost to iho drive. 

6. TTBiiig the fafittmatimi fiom dhanpe deteetton in solution 3. blank out, fi>g over, or 

25 otfaerwisedeslXDyfiieviewingpleasureoffiieboxedareainwhiohfiiowatemiaikwas 
detected. Alternatively, scroll a message across fiis whole hnage indtoating the 
detection of a watecmaric in anonrauthentioated stream. 

7. . . llieoperoting^ystem and file BIOS arefiieonfy entitles in file PC T^dihave-r^^ - -• 

knowledge fiboot fiie plug-in card configmatian of the PC. A sohitioa fiir the first baoilc- 
30 scenario is Ibr file BIOS or OS 10 pioMbitoomhinBtions of con^pliantan^ 

compliant gr^cs cards in aPC (fbr security reasons). A solution &r file second haok- 
sceoario is fbr OS and BIOS to dissllow authentication with graphics cards across fiie 
network. A way to hiqilement fids would be fbr the OS to query the drive whidh 
graj^os card it aufiientioated wifii and to check that the device is indeed on board. This 
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obviously zetiiTO a seoute OS. If itis amarketreipxiremciit&a^ 
xemotc DVD-drive in a borne network should be allowed, the tsecoud scenario ba^ of 
probletii 7 oaanotbo preveoited. Another solution is fiir fhe OS to xxralubit ootnbjnatioas 
of oompHant ddvo ff"* nfflPi-coitip]l^''"t gr^bioB card in llie same box. 
3 8. Thff avfrgntiffitf^nw-wghCTT^ fe» *ha watermark detector should be endowed with a 

tevooation soheme as diainpionedby e.g. Philip's Sapiphiie ardhiteoture. If a backer 
op^ up a gr^pMos oaid, sudi casd can be tevoted by (can no loiiser co^^ 

witlQ fbtqre drives, OS-es» media etc 

Note that, as meiutioned belbre^ Ibe DVD-ddve could be replaced by any olbsr 

10 ctanpSisat source of data in Ibese sofaitiom. 

The inveotion can be sunimaxized as fiillaws. Wateti^^ 
graphics card fbr the purpose of cqpy-proteotlon in a PC, has recently started to draw a lot of 
attention in standardization. However, detBction in a gng*ios card has proMema completely 
diffbimt from the fomerly considered detection in the DVD-drive^ having to do wifli high 

15 datflprates, large scale-ranges and presence of muMqile video-streams hi the display area. This 
disolosore discusses anumber of t^roachra to confiont these problems. 
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Abstract 



Wotaanatk-deteotion in & graphics card fiir &e jmrpose of copy-pcotectiaa m a PC, lias 
zeoeatitly started to draw a lot of attootlan In staodaidizatian. However, dsteotkm in a gR^cs 
oaid lias pioblems completely different Scam the fixrtnerly coiuiderBd detection in fhs DV2>^ 
diivc^ having to do wift high data-tatss, laige 8oale>-rangs8 and presence of nynltiple video>- 
5 streanu in the display area. This disolosmn discusses anumber of approaches to oonftcmt 
these problems. 
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